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(54) SPEECH PROCESSING DEVICE 
(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a 
more user-friendly speech processing 
device. 

SOLUTION: This speech processing 
device reads a speech data, which has 
been recorded in a miniature card 2 and 
recorded by a digital recorder 1 , by a 
personal computer 4; calculates SN ratio 
of the speech data read by this personal 
computer 4 and judges whether or not the 
value of the SN ratio is proper; and if it is 
proper, the speech processing device 
recognizes the speech data by a speech 
recognition program 9. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation 

may not reflect the original precisely. 

2.**** shows the word which can not be translated. 

3.1n the -drawings, any words are not translated. 



CLAIMS 
[Claim(s)] 

[Claim 1] The speech processing unit carry out providing the speech- 
recognition processing means which carries out the speech-recognition 
processing of the above-mentioned voice data when it is judged from 
the record medium with which voice data was recorded with the voice- 
data read-out means which reads voice data, a signal-to-noise-ratio 
operation means calculate the signal-to-noise ratio of the voice data 
read with the above-mentioned voice-data read-out means, a signal-to- 
noise-ratio decision means judge that the output value of the above- 
mentioned signal-to-noise-ratio operation means is proper, and the 
above-mentioned signal-to-noise-ratio decision means that the above- 
mentioned output value is proper as the description. 
[Claim 2] the case where it is judged with the above-mentioned signal- 
to-noise-ratio decision means that the above-mentioned output value is 
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hot proper — this — the speech processing unit according to claim 1 
characterized by providing further a warning means to display the 
purport which is not proper. 

[Claim 3] The speech processing unit according to claim 1 characterized 
by providing further a selection means to choose as the above- 
mentioned voice data whether speech recognition processing is 
performed when it is judged with the above-mentioned S/N decision 
means that the above-mentioned output value is not proper. 



[Translation done.] 
* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation 

may not reflect the original precisely. 

2.**** shows the word which can not be translated. 

3.1n the drawings, any words are not translated. 



DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to a speech processing 
unit and the speech processing unit which performs predetermined 
processing to the voice data read from the record medium in detail. 
[0002] 

[Description of the Prior Art] The so-called dictate system 
implementation which will draw up a document automatically based on 
this voice data, and will display it on a screen etc. if voice data is 
inputted the so-called voice word processor or by stating orally is one 
target in the speech recognition system development from the former, 
and research is advanced actively now. 

[0003] The equipment which connects a microphone to a personal 
computer, documents the voice inputted using this microphone on this 
personal computer with an advance of such a speech recognition 
technique in recent years and a computer technique, and is displayed on 
a screen is developed, and, generally it is marketed. 
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[0004] Oral statement sound recording of the content of the document 
[ in drawing up a document ] to draw up conventionally on the other 
hand was once carried out at sound recording equipments, such as a 
tape recorder, and it has become common as one of the effective 
utilization gestalten of sound recording equipments, such as a tape 
recorder, to take the gestalt of documenting with document preparation 
equipments, such as a typewriter and a word processor, while a 
secretary, a typist, etc. reproduce the content of oral statement later. 
[0005] Implementation of the technique of changing the content of 
sound recording into a document from before automatically in such oral 
statement sound recording is desired strongly. 

[0006] Moreover, it is possible for the so-called digital recorder which 
digital-data-izes the content of sound recording, and is recorded on the 
record medium in which the writing of a flash memory etc. and 
elimination are possible by development of computer technology in 
recent years, a digital-signal-processing technique, etc. to comes to be 
developed, to transmit the digitized content of sound recording to a 
personal computer further, and to reproduce the content of sound 
recording in this personal computer. 

[0007] These people are developing the processing control unit of the 
voice data which makes it possible to set simply the sound recording 
data transmitted from such a digital recorder on a personal computer, 
and to treat them by easy actuation, and have proposed in Japanese 
Patent Application No. No. 149728 [ nine to ]. 

[0008] Furthermore, these people pass and do speech recognition of the 
voice by which digital recording was carried out to a voice recognition 
unit from the processing control device of the above-mentioned voice 
data, the dictate system displayed on a screen as a document is 
developed, and it has proposed in Japanese-Patent-Application-No. 9- 
I49729 No. 

[0009] According to such a dictate system, it is not necessary to sit 
down in front of a computer and to carry out a direct sound voice input, 
it once records into a digital recorder, and it becomes possible to 
transmit the sound recording data to a computer later, and to make a 
document draw up. 
[0010] 

[Problem(s) to be Solved by the Invention] By the way, the large lexical 
continuous speech recognition technique for unspecified speakers is 
needed for speech recognition processing in a dictate system which was 
mentioned above. However, in the current large lexical continuous 
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speech recognition technique for unspecified speakers, obtaining a 
perfect recognition result without incorrect recognition has the problem 
that the recognition engine performance deteriorates, when it is very 
difficult and a background noise mixes into the voice for recognition 
especially. In order to solve such a problem conventionally, it is just 
going to be known well that various proposals are made. However, it is 
difficult to solve it with limited equipment. 

[001 1] If it is when using the equipment which connects a microphone to 
a personal computer which was mentioned above, documents the voice 
inputted using this microphone on this personal computer, and is 
displayed on a screen in such the actual condition, the speech- 
recognition result displayed on a screen on that spot checks, and it is 
decision of a user, and if there is much incorrect recognition, it is 
possible to also take response of redoing voice input again. 
[0012] In the dictate system displayed on a screen on the other hand by 
using as a document the result of having made carrying out voice data 
which was mentioned above, and by which digital recording was carried 
out to a processing control unit to a voice recognition unit, and having 
recognized speech recognition, the already recorded voice data serves 
as an input to a voice recognition unit. 

[0013] Therefore, when a loud background noise performs speech 
recognition processing to the voice data mixed and recorded, a 
recognition result with it there is much incorrect recognition and difficult 
[ to even correct later ] will be displayed, and even if it reperforms 
speech recognition processing again by decision of a user, there is a 
problem that there is no chance that a recognition result will be 
improved. 

[0014] The place which a dictate system which was mentioned above 
makes the original object is for it to be more quick and document the 
content of the recorded voice data more simply, i.e., offer document 
preparation exchange. Since what is necessary is just to correct the 
incorrect recognition part using a keyboard, a mouse, etc. if incorrect 
recognition parts are few as a result of the speech recognition 
processing to the recorded voice data, the object can be attained. 
[0015] However, if an incorrect recognition part increases above to 
some extent, even correction will become difficult and will be referred to 
as being able to draw up a document having retyped quickly [ way ] from 
the start after all. A user will be burdened with big disadvantage in 
saying [ that it does not turn out that it is such unless it processes 
actually and achieves results ]. 
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[0016] this invention is made in view of this trouble — having — more - 
- user FUREN — it aims at offering a dolly speech processing unit. 
[0017] 

[Means for Solving the Problem] In order to attain the above-mentioned 
object the 1 st speech processing unit of this invention The voice data 
read-out means which reads voice data from the record medium with 
which voice data was recorded, A signal-to-noise-ratio operation means 
to calculate the signal-to-noise ratio of the voice data read with the 
above-mentioned voice data read-out means, A signal-to-noise-ratio 
decision means to judge whether the output value of the above- 
mentioned signal-to-noise-ratio operation means is proper, and the 
speech recognition processing means which carries out speech 
recognition processing of the above-mentioned voice data when it is 
judged with the above-mentioned signal-to-noise-ratio decision means 
that the above-mentioned output value is proper are provided. 
[0018] the case where the 2nd speech processing unit of this invention 
judges that the above-mentioned output value is not proper with the 
above-mentioned signal-to-noise-ratio decision means in the 1 st 
speech processing unit of the above in order to attain the above- 
mentioned object — this — a warning means to display the purport 
which is not proper is provided further. 

[0019] In order to attain the above-mentioned object, the 3rd speech 
processing unit of this invention possesses further a selection means to 
choose as the above-mentioned voice data whether speech recognition 
processing is performed, in the 1st speech processing unit of the above, 
when it is judged with the above-mentioned S/N decision means that 
the above-mentioned output value is not proper. 
[0020] 

[Embodiment of the Invention] Hereafter, the gestalt of operation of this 
invention is explained with reference to a drawing. 
[0021] Drawing 1 thru/or drawing 6 start the dictate system which is 1 
operation gestalt of this invention, and drawing 1 is drawing having 
shown the notional whole configuration of this dictate system. 
[0022] The digital recorder 1 which changes voice into an electrical 
signal and voice-data-izes it as this dictate system is shown in drawing 
1 , Record-medium slack Miniature Card 2 which equips this digital 
recorder 1 removable, is used for it, and records the above-mentioned 
voice data, The PC card adapter 3 for inserting in PC Card slot 40 
(referring to d rawin g 2 ) which mentions this Miniature Card 2 later, and 
making connection possible, To the voice data which was equipped with 
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the output means slack display 5, the keyboard 6, and the mouse 7 
grade, and was obtained from above-mentioned Miniature Card 2 
through above-mentioned PC Card slot 40 It has the personal computer 
4 as a speech processing unit which performs processing by the control 
program 8 or the speech recognition program 9, and is constituted. 
[0023] In addition, the above-mentioned display 5 achieves the duty as a 
warning means to display the purport which is not proper. 
[0024] Drawin g 2 is the block diagram showing the electric configuration 
of the above-mentioned personal computer 4. 
[0025] While this personal computer 4 performs voice playback, an 
information display, etc. according to the above-mentioned control 
program 8 and performs document preparation etc. according to the 
above-mentioned speech recognition program 9 While performing various 
processings according to various kinds of other programs and managing 
control of the personal computer 4 whole concerned CPU31 which 
achieves duties, such as a voice data read-out means, a signal-to- 
noise-ratio operation means, a signal-to-noise-ratio decision means, 
and a speech recognition processing means, The record-medium slack 
main memory 32 used as the working area of this CPU31, For example, 
the interior record medium 33 of record-medium slack with which it 
becomes by the hard disk, a floppy disk, etc., and the above-mentioned 
control program 8 and the speech recognition program 9 are recorded, 
The external port 34 for connecting with various kinds of external 
instruments, and the interface 35 which connects the above-mentioned 
display 5 (it abbreviates to IF hereafter), IF36 which connects the 
above-mentioned keyboard 6 and a mouse 7, and the loudspeaker 38 
which utters voice based on voice data, It has IF37 which connects this 
loudspeaker 38, PC Card slot 40 in which Miniature Card 2 with which 
the above-mentioned PC card adapter 3 was equipped is inserted, and 
IF39 for connecting this PC Card slot 40, and is constituted. 
[0026] Moreover, the above CPU 31, main memory 32, the internal 
record medium 33, the external port 34, and IF 35, 36, 37, and 39 are 
mutually connected through the bus. 

[0027] In addition, although you may make it read from Miniature Card 2 
directly through above-mentioned PC Card slot 40, voice data is 
recorded on the above-mentioned internal record medium 33, and it may 
be made to once read it from this internal record medium 33, or even if 
it makes it read from the digital recorder 1 directly through means of 
communications etc., it is not cared about. 

[0028] Moreover, the above-mentioned loudspeaker 38 achieves the 
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duty as a warning means which displays the purport which is not proper 
(pronunciation). 

[0029] Next, the speech recognition processing in the dictate system of 
this operation gestalt is explained with reference to draw ing 3 and 
dra win g 4 . 

[0030] D rawi ng 3 is the conceptual diagram showing the whole flow when 
reading and carrying out speech recognition of the voice data from voice 
memory in the dictate system of this operation gestalt, and dr awing 4 is 
a flow chart which shows processing of the speech recognition in this 
dictate system. 

[0031] If speech processing is started as shown in dr awin g 4 , the voice 
data currently recorded in the file unit will be read from the voice 
memory 1 1 (record medium with which voice data was recorded) as a 
record medium with which above-mentioned Miniature Card 2 or the 
above-mentioned internal record-medium 33 grade, and voice data were 
recorded (step S1), and decryption processing 12 will be performed (step 
S2). 

[0032] The result of this decryption processing 1 2 calculates an SN 
ratio by the technique which it is sent to the SN ratio (signal-to-noise 
ratio) computation 1 3, for example, is mentioned later (step S3). 
[0033] The calculated value (S/N) of this SN ratio is compared with the 
predetermined value m by the judgment processing 14 (step S4). In this 
step S4, if it is S/N>m, voice data will be sent to the speech recognition 
processing 1 5, and speech recognition will be performed (step S5). And 
the result of this speech recognition is displayed on the screen of 
display 5 grade (step S6). 

[0034] By the above-mentioned step S4, if it is not S/N>m, warning of 
the purport that the recognition result which may continue speech 
recognition as it is will not be obtained will be displayed on a display 5 
(step S7). 

[0035] In addition, this alarm display may not be restricted for making it 
display on a display 5, for example, you may warn of it with voice etc. 
from a loudspeaker 38. 

[0036] After the above-mentioned warning, speech recognition 
processing is performed as it is, activation of processing is stopped, or 
selection is demanded from a user (step S8). In addition, also by the key 
stroke on a keyboard 6, this selection is good and may be operated by 
mouse 7 grade. 

[0037] As a result of selection by the above-mentioned user, if it is yes, 
it will carry out to step S5 and speech recognition processing will be 
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performed. On the other hand, processing will be ended if it is no as a 
result of selection by the user. 

[0038] Next, the content of processing of the SN ratio computation in 
the above-mentioned step S3 is explained with reference to the flow 
chart shown in drawing 5 and drawing 6 . 

[0039] First, it explains with reference to the flow chart which shows the 
count technique of the noise level of voice data to dra wing 5 . 
[0040] If this processing starts, the variable f which shows the counted 
value of a frame number will be first initialized to 0 (step S1 1). 
[0041] Next, after incrementing Variable f, frame energy e (f) is 
calculated with (step S12) and the formula of a graphic display (step 
S13). In addition, an input signal [ in / in s (i) / the sample of eye (i) 
watch in one frame ] and N show among the formula the measurement 
size which constitutes one frame. 

[0042] Next, it judges whether it is the frame of whether the value of 
Variable f is 1, and the first stage (step S14), and when f is 1, the value 
of the variable min which shows the minimum frame energy is set to e 
(1) (step S16). 

[0043] Moreover, when f is not 1 in the above-mentioned step S14, it 
judges whether frame energy e (f) is smaller than Variable min (step 
S15), in being small, it sets frame energy e (f) to Variable min (step S17), 
and in not being small, on the other hand, it goes to the following step 
S18, without doing anything as it is. 

[0044] And it judges whether the file reached termination (step S18), 
and in not being termination still, it repeats the processing which 
returned and mentioned above to the above-mentioned step S12. 
[0045] Moreover, when it is judged that the end of file was reached in 
this step S18, the value which integrated the predetermined value alpha 
(for example, 1 .8) is set to the above-mentioned variable min as 
threshold noiselev (step S19), and it escapes from this processing. 
[0046] Such a detection approach of noise level uses effectively that 
voice data is already recorded, and becomes possible [ **(ing) to count 
of an accurate SN ratio ]. 

[0047] In addition, although the minimum value of the read entire interval 
(that is, all frames that constitute a voice file) is calculated in ****, 
even if this invention is not limited to this and is no minimum value of 
the sections, it should just be the section of a certain amount of die 
length. 

[0048] Next, it explains with reference to the flow chart which shows the 
content of the processing which calculates an SN ratio to drawing 6 . 
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[0049] If this processing starts, the variable Cnt which shows the 
variable Sum which shows the aggregate value of the variable f which 
shows the counted value of a frame number, and the signal-to-noise 
ratio (SN ratio) of each frame, and the count of addition will be 
respectively initialized to "0" (step S21). 

[0050] Next, frame energy e (f) which calculated Variable f in drawing 5 
incremented and (step S22) mentioned above judges whether it is larger 
than noise level noiselev (step S23). In being larger than noiselev, e (f) 
adds the calculated value of the signal-to-noise ratio of the frame 
concerned to the variable Sum itself (step S24), and increments Variable 
Cnt here (step S25). 

[0051] Moreover, in the above-mentioned step S23, when e (f) is below 

noiselev, it moves to the following step S26 as it is. 

[0052] Next, the processing which returned and mentioned above 

whether the file reached termination to the above-mentioned step S22 

when it judged (step S26) and termination was not reached yet is 

repeated. 

[0053] Moreover, when [ which reached the end of file in this step S26 ] 
it judges, the average SN ratio of a signal-to-noise ratio is calculated by 
dividing the above-mentioned variable Sum by Variable Cnt (step S27). 
[0054] thus — according to the above-mentioned operation gestalt — 
more — user FUREN — a dolly dictate system can be offered. 
[0055] According to the operation gestalt of **** this invention 
explained in full detail more than the [additional remark], the 
configuration like a less or equal can be obtained. Namely, (1) The voice 
data read-out means which reads voice data from the record medium 
with which voice data was recorded, A signal-to-noise-ratio operation 
means to calculate the signal-to-noise ratio of the voice data read with 
the above-mentioned voice data read-out means, A signal-to-noise- 
ratio decision means to judge whether the output value of the above- 
mentioned signal-to-noise-ratio operation means is proper, The speech 
processing unit characterized by providing the speech recognition 
processing means which carries out speech recognition processing of 
the above-mentioned voice data when it is judged with the above- 
mentioned S/N decision means that the above-mentioned output value 
is proper. 

[0056] (2) the case where it is judged with the above-mentioned signal- 
to-noise-ratio decision means in the speech processing unit of a 
publication to the above (1) that the above-mentioned output value is 
not proper — this — provide further a warning means to display the 
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purport which is not proper. 

[0057] (3) When it is judged with the above-mentioned S/N decision 
means in a speech processing unit given in the above (1) that the 
above-mentioned output value is not proper, provide further a selection 
means to choose as the above-mentioned voice data whether speech 
recognition processing is performed. 

[0058] (4) the case where it is judged with the above-mentioned signal- 
to-noise-ratio decision means in the speech processing unit of a 
publication to the above (1) that the above-mentioned output value is 
not proper — this — provide further a warning means to display the 
purport which is not proper, and a selection means to choose as the 
above-mentioned voice data whether speech recognition processing is 
performed. 

[0059] (5) The above (1) An output means to output the recognition 
result of the above-mentioned speech recognition processing means to 
- (4) in the speech processing unit of a publication is provided. 
[0060] A printer besides a display 5 etc. corresponds as this output 
means. 

[0061] (6) The above (1) In a speech processing unit given in - (5), the 
above-mentioned signal-to-noise-ratio decision means possesses a 
comparison means to compare the output value and initialization 
reference value of the above-mentioned signal-to-noise-ratio operation 
means. 

[0062] It is the record medium which recorded the processing program 
for carrying out processing which passes voice data to a speech 
recognition program by computer. (7) The above-mentioned processing 
program The above-mentioned voice data is made to read from the 
record medium with which the above-mentioned voice data was 
recorded on the computer. The record medium which is made to 
calculate the signal-to-noise ratio of the read above-mentioned voice 
data, was made to judge whether the value of a signal-to-noise ratio is 
proper, and recorded the processing program characterized by making 
the above-mentioned voice data pass to a speech recognition program 
when the value of a signal-to-noise ratio was proper. 
[0063] It is the record medium which recorded the processing program 
for carrying out processing which passes voice data to a speech 
recognition program by computer. (8) The above-mentioned processing 
program The above-mentioned voice data is made to read from the 
record medium with which the above-mentioned voice data was 
recorded on the computer. Make the signal-to-noise ratio of the read 
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above-mentioned voice data calculate, and it is made to judge whether 
the value of a signal-to-noise ratio is proper. When the value of the S/N 
is not proper, it is made to choose whether speech recognition 
processing of the above-mentioned voice data is given to an operator. 
The record medium which recorded the processing program 
characterized by making the above-mentioned voice data pass to a 
speech recognition program when the value of a signal-to-noise ratio is 
proper, and when activation of speech recognition processing of an 
operator is chosen. 

[0064] It is the record medium which recorded the speech recognition 
program for carrying out speech recognition by computer. (9) The 
above-mentioned program The above-mentioned voice data is made to 
read from the record medium with which the above-mentioned voice 
data was recorded on the computer. Make the signal-to-noise ratio of 
the read above-mentioned voice data calculate, and it is made to judge 
whether the value of a signal-to-noise ratio is proper. When the value of 
the S/N is not proper, it is made to choose whether speech recognition 
processing of the above-mentioned voice data is given to an operator. 
The record medium which recorded the speech recognition program 
characterized by carrying out speech recognition of the above- 
mentioned voice data when the value of a signal-to-noise ratio is 
proper, and when activation of speech recognition processing of an 
operator is chosen. 
[0065] 

[Effect of the Invention] according to [ as explained above ] this 
invention — more — user FUREN — a dolly speech processing unit can 
be offered. 



[Translation done.] 
* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation 
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2.**** shows the word which can not be translated. 

3.1n the drawings, any words are not translated. 
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DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing 1] It is drawing having shown the notional whole configuration 
of the dictate system of 1 operation gestalt of this invention. 
[Drawing 2] It is the block diagram showing the electric configuration of 
the personal computer in the dictate system of the above-mentioned 
operation gestalt. 

[Drawing _3] In the dictate system of the above-mentioned operation 
gestalt, it is the conceptual diagram showing the whole flow when 
reading and carrying out speech recognition of the voice data from voice 
memory. 

[Drawing 4] It is the flow chart which shows the speech recognition 
processing in the dictate system of the above-mentioned operation 
gestalt. 

[ Drawin g 5] It is the flow chart which showed the count technique of the 
noise level of the voice data in the dictate system of the above- 
mentioned operation gestalt. 

[Drawing 6] It is the flow chart which showed the content of the 
processing which calculates the SN ratio in the dictate system of the 
above-mentioned operation gestalt. 
[Description of Notations] 



1 - 


— Digital recorder 


2 - 


— Miniature Card (record medium) 


4- 


- Personal computer (speech processing unit) 


5 - 


— Display (an output means, warning means) 


6 - 


— Keyboard (selection means) 


7 - 


— Mouse (selection means) 


8 - 


- Control program 


9 - 


— Speech recognition program 


11 


— Voice memory (record medium) 


12 


— Decryption processing 


13 


— SN ratio computation 


14 


— Judgment processing 


15 


— Speech recognition processing 


16 


— Display 


31 


— CPU (a voice data read-out means, a signal-to-noise-ratio 



operation means, a signal-to-noise-ratio decision means, speech 
recognition processing means) 

32 — Main memory (record medium) 

33 — Internal record medium (record medium) 
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38 — Loudspeaker (warning means) 

[Translation done.] 
* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation 

may not reflect the original precisely. 

2.**** shows the word which can not be translated. 

3.1n the drawings, any words are not translated. 
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[Drawing 1] 




[Drawing 2] 
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[Drawing 3] 
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[ Drawing 4] 
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[Drawing 6] 
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[Drawi ng 5] 
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[Translation done.] 
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